Fast Eigen Decomposition for Low-Rank Matrix Approximation
نویسنده
چکیده
In this paper we present an efficient algorithm to compute the eigen decomposition of a matrix that is a weighted sum of the self outer products of vectors such as a covariance matrix of data. A well known algorithm to compute the eigen decomposition of such matrices is though the singular value decomposition, which is available only if all the weights are nonnegative. Our proposed algorithm accepts both positive and negative weights.
منابع مشابه
A Decomposition Method for Weighted Least Squares Low-rank Approximation of Symmetric Matrices
Least squares approximation of a symmetric matrix C by a symmetric positive definite matrix Ĉ of rank at most p is a classical problem. It is typically solved by computing an eigen-decomposition of C and by truncating the eigen-decomposition by only using the eigenvectors and associated with the min(p, q) largest positive eigenvalues of C. Here q is the number of positive eigenvalues. Thus if q...
متن کاملA Fast Incremental Algorithm for Low Rank Approximations of Matrices and Its Applications in Facial Images
This paper presents a fast incremental algorithm for low rank approximations or dimensionality reduction of matrices. Assuming that matrices have double-sided type of decomposition, we can set up an incremental solution that constitutes two coupled eigenmodels and thus a two-step updating procedure. At each step, we first represent row-row or column-column covariance matrix as the form of eigen...
متن کاملA Sparse Decomposition of Low Rank Symmetric Positive Semidefinite Matrices
Suppose that A ∈ RN×N is symmetric positive semidefinite with rank K ≤ N . Our goal is to decompose A into K rank-one matrices ∑K k=1 gkg T k where the modes {gk} K k=1 are required to be as sparse as possible. In contrast to eigen decomposition, these sparse modes are not required to be orthogonal. Such a problem arises in random field parametrization where A is the covariance function and is ...
متن کاملA Rank Revealing Randomized Singular Value Decomposition (R3SVD) Algorithm for Low-rank Matrix Approximations
— In this paper, we present a Rank Revealing Randomized Singular Value Decomposition (R 3 SVD) algorithm to incrementally construct a low-rank approximation of a potentially large matrix while adaptively estimating the appropriate rank that can capture most of the actions of the matrix. Starting from a low-rank approximation with an initial guessed rank, R 3 SVD adopts an orthogonal Gaussian sa...
متن کاملFast Exact Matrix Completion with Finite Samples
Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works (Keshavan, 2012; Jain et al., 2013; Hardt, 2014) have proposed fast non-convex optimization based iterative algorithms to solve this problem. However, the sample complexity in all these results is sub-optimal in its dependence on the rank, condition number and ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1706.02069 شماره
صفحات -
تاریخ انتشار 2017